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Abstract 
Dialectical  Inquiry  has  been  offered  as  an  aid  to  strategic  planning 
and  contrasted  with  a  Devil's  Advocate  approach.   This  study  helps 
resolve  the  ambiguity  in  the  results  of  earlier  research  on  these 
planning  aids  by  demonstrating  that  Dialectical  Inquiry  increases  deci- 
sion-makers' satisfaction  with  strategy  formulation  without  necessarily 
improving  performance. 


D i alecti cal  Inquiry: _ _  Decision-Makers ' 
Perceptions  of  Its  Effectiveness 


Quantitative  decision-making  aids  which  have  proved  helpful  with  rela- 
tively well-structured  problems  are  of  limited  use  in  strategy  formulation. 
Because  strategy  formulation  represents  a  special  kind  of  ill-structured 
decision-making  (Hofer  and  Schendel,  1978),  more  qualitative  or  behavioral 
assistance  may  be  required.   One  widely  recommended  behavioral  aid  to  stra- 
tegy formulation  is  the  Dialectical  Inquiry  System  (DIS)  (Churchman,  1971; 
Emshoff  and  Mitroff,  1978,  Mason,  1969;  Mitroff  and  Kilmann,  1978). 

The  DIS  was  first  proposed  as  an  aid  to  strategic  planning  by  Mason 
(1969)  and  contrasted  with  a  Devil's  Advocate  (DA)  approach.   Both  the  DIS 
and  DA  are  intended  as  improvements  on  the  expert  (E)  approach  in  which 
strategic  decisions  are  made  with  the  aid  of  preliminary  analyses  and  pro- 
posals by  staff  "experts."   According  to  Mason,  these  analyses  and  proposals 
contain  unstated  assumptions  and  biases  which  remain  unquestioned  and  may 
adversely  affect  the  quality  of  a  company's  strategy. 

The  DIS  and  DA  are  techniques  for  encouraging  managers  to  question  the 
assumptions  in  staff  proposals.   The  DIS  involves  examination  of  the  assump- 
tions underlying  an  expert's  proposal,  the  negation  of  these  assumptions, 
and  the  development  of  a  counterproposal  based  on  the  counter  assumptions. 
The  proposal  and  counterproposal  are  then  presented  to  decision-makers 
through  a  structured  debate.   The  DA,  on  the  other  hand,  involves  the  iden- 
tification of  assumptions  and  the  development  of  a  critique  of  these  assump- 
tions rather  than  a  counterproposal.   The  proposal  and  critique  are  then 
presented  to  decision-makers  in  a  debate  format. 

A  number  of  authors  in  addition  to  Mason  have  proposed  the  DA  as  an 
ill-structured  decision-making  aid  (Cosier,  1978;  Dale.  1975;  Herbert  and 
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Estes,  1977;  Janis  and  Mann,  1977).   However,  Mason  (1969,  pp.  B^07-B408) 
maintains  that  the  DIS  should  be  more  helpful  in  strategic  planning  than 
the  DA  because  it  involves  the  development  of  a  constructive  alternative  to 
the  expert's  proposal  while  the  DA  merely  criticizes  the  proposal. 

Field  and  laboratory  research  on  these  two  decision-making  aids  has 
produced  mixed  and  even  contradictory  results.   Some  studies  have  shown 
positive  effects  for  the  DIS  while  others  have  shown  no  effects  for  the  DIS 
but  positive  effects  for  the  DA. 

Previous  Research  on  the  DIS  and  DA 

Several  field  experiments  have  examined  the  effects  of  the  DIS  on 
strategy  formulation.   Mason  (1969)  applied  the  DIS  to  an  abrasives  manu- 
facturing company.   He  obtained  a  strategic  planning  document  from  the 
company's  planning  department,  identified  its  ten  underlying  assumptions, 
and  constructed  a  counterplan  based  on  opposite  assumptions.   The  plan  and 
counterplan  were  then  presented  to  management  in  a  structured  debate. 
Mason  reported  that  the  company's  managers  were  able  to  form  a  "new,  encom- 
passing view"  of  the  planning  problem  and  were  more  satisfied  with  the 
strategy  they  developed  using  the  DIS. 

Mitroff,  Barabba,  and  Kilmann  (1977)  used  the  DIS  on  a  planning  problem 
at  the  Bureau  of  Census  in  Washington,  D.C.   Groups  of  Census  Bureau 
employees  developed  planning  reports  based  on  differing  assumptions  sug- 
gesting different  future  directions  for  the  Bureau.   Finally,  they  produced 
an  integrative  report.   According  to  the  Bureau  employees,  the  DIS  had  been 
valuable  and  the  final  report  it  produced  was  exciting  and  innovative. 
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Emshoff  and  Finnel  (1978)  applied  a  DIS-based  approach  called  Strategic 
Assumption  Analysis  to  a  company  they  fictitiously  labeled  Basic  Materials. 
A  planning  group  used  this  approach  to  revise  a  strategic  plan  they  had 
developed.   The  company's  management  stated  that  the  DIS  assured  a  more 
thorough  analysis  of  the  data  and  produced  a  revised  strategy  statement 
which  was  superior  to  the  initial  strategy  (Emshoff  and  Finnel,  1978,  p. 
30).   Mitroff  et  al.  (1979)  applied  the  DIS  to  a  pricing  decision  in  a  drug 
company.   Three  groups  of  managers,  each  advocating  a  different  pricing 
policy,  used  the  DIS  to  examine  their  divergent  assumptions  and  arrive  at 
a  final  pricing  policy.   The  authors  reported  that  the  DIS  produced  more 
and  better  pricing  alternatives  and  a  more  firm  consensus  on  the  chosen 
alternative. 

In  summary,  the  field  research  on  the  DIS  has  shown  that  some  decision- 
makers respond  positively  to  the  DIS  and  feel  that  its  use  leads  to  better 
strategy  formulation  than  the  traditional,  non-conf lictful  approaches  they 
had  been  using.   Based  on  these  results,  proponents  of  the  DIS  have 
concluded  that  its  use  leads  to  more  effective  strategy  formulation  than 
E  approach.   However,  the  field  experiments  contained  a  number  of 
uncontrolled  variables  and  confounding  factors  which  limit  the  generali- 
zability  of  the  results.   Further,  none  of  these  experiments  involved  a 
direct  comparison  of  the  DIS  to  the  DA.   A  number  of  comparative  studies 
have  addressed  these  concerns. 

Cosier  (1978)  compared  the  E,  DIS,  and  DA  using  a  prediction  task  in 
which  subjects  predicted  criterion  values  from  cues  having  a  probabilistic 
relationship  to  the  criterion.   Thus,  this  task  bore  some  similarity  to  the 
strategy  formulation  task  in  that  it  required  subjects  to  use  ambiguous 
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environmental  information  to  predict  outcomes.   Subjects  in  the  E  condition 
received  a  planning  report  from  an  "expert"  recommending  that  they  focus  on 
one  particular  cue  out  of  three  they  received  in  making  their  predictions. 
Subjects  in  the  DA  condition  received  this  same  "expert"  report  plus  a  cri- 
tique which  questioned  the  assumptions  of  the  first  report  but  offered  no 
alternative  recommendations.   Subjects  in  the  DIS  condition  were  given  the 
"expert"  report  plus  a  counterproposal  which  recommended  that  a  different 
cue  be  emphasized  in  the  predictions. 

All  subjects  made  twenty  predictions  in  each  of  three  distinct  con- 
texts or  "states  of  the  world."   In  each  world  state,  the  cue-criterion 
relationships  were  different.   Cosier  found  that  in  one  of  the  world  states, 
the  DA  subjects  made  significantly  more  accurate  predictions  than  the  E  or 
DIS  subjects  while  in  the  other  two  world  states  there  were  no  significant 
differences.   Thus,  the  results  of  this  study  weakly  favored  the  DA. 

Later  laboratory  studies  using  a  similar  experimental  design  have 
generally  favored  the  DA  over  the  DIS  (Cosier.  1980(a);  Cosier,  Ruble,  and 
Aplin.  1978,  Schwenk  and  Cosier,  1980).   However,  the  prediction  task  used 
in  these  studies  does  not  capture  the  full  complexity  of  the  strategy  for- 
mulation task.   Though  prediction  or  forecasting  may  be  an  important  part 
of  strategy  formulation,  it  is  only  one  component. 

Cosier  and  Aplin  (1980)  extended  previous  comparative  research  by  exa- 
mining the  effects  of  the  DA  and  DIS  using  a  strategy  formulation  task. 
Subjects  (Planners  with  the  United  Way  of  America)  were  asked  to  formulate 
strategic  recommendations  for  a  United  Way  agency  described  in  a  case  and 
were  randomly  assigned  to  either  the  E,  DIS,  DA,  or  C  (control)  conditions. 
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The  planners'  recommendations  were  evaluated  by  judges  along  several  dimen- 
sions proposed  by  Tilles  (1963).   The  evaluations  of  the  recommendations 
generated  by  the  DA  planners  were  higher  than  the  evaluations  of  recommen- 
dations generated  by  the  DIS  planners  on  all  evaluative  dimensions  though 
this  difference  was  only  significant  on  one  of  the  dimensions. 

In  conclusion,  then,  the  comparative  research  on  the  DA  and  DIS  does  not 
support  the  claims  of  the  field  researchers  regarding  the  benefits  of  the 
DIS.   The  comparative  research  has  shown  that  the  DA  improves  prediction 
performance  and  overall  quality  of  strategy  statements  more  than  the  DIS. 

One  possible  explanation  for  this  discrepancy  is  that  the  dependent 
variable  examined  in  the  field  studies  was  different  from  the  one  used  in 
the  comparative  studies.   In  the  field  research,  data  was  gathered  on  deci- 
sion-makers' perceptions  of  the  strategy  formulation  task  and  their  satis- 
faction with  it.   In  the  comparative  studies,  decision-makers'  performance 
was  the  dependent  variable.   If  it  could  be  shown  that  the  DIS  improves 
decision-makers'  satisfaction  without  necessarily  improving  performance, 
this  might  begin  to  resolve  the  apparent  discrepancy  between  the  two  streams 
of  research. 

Cosier  (1980b)  measured  the  effects  of  the  DA  and  DIS  on  subjects' 
affective  responses  to  a  prediction  task.   From  a  factor  analysis  of  a 
fifteen-item  post-task  questionnaire,  he  identified  five  orthogonal  factors 
which  made  up  subjects'  affective  responses  to  the  task  and  to  the  DA  and 
DIS.   These  factors  were  labeled:   Satisfaction,  Value  of  Planning  Informa- 
tion, Effort,  Value  of  Each  Expert's  Advice,  and  Task  Attractiveness.   In 
this  experiment,  as  in  earlier  laboratory  experiments  comparing  the  DA  and 
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DIS,  subjects  were  required  to  make  twenty  predictions  in  each  of  three 
contexts  or  "world  states."   Each  subject  received  these  contexts  in  one 
of  three  orders  of  presentation.   Cosier  found  that  in  one  of  the  three 
orders  of  presentation  the  DA  subjects  reported  that  the  experts'  advice 
was  significantly  more  helpful  than  did  the  D1S  subjects.   No  significant 
differences  were  found  in  the  other  two  orders. 

Method 

The  present  study  examined  the  effects  of  the  DA  and  D1S  on  decision- 
makers' performance  and  affective  responses  to  a  strategy  formulation  task. 
Eighty  upper  division  undergraduate  business  students  participated  in  the 
study.   All  subjects  had  some  level  of  sophistication  in  business  policy 
case  analysis  through  a  series  of  required  functional  area  courses  and  a 
major  project  in  which  they  analyzed  an  integrative  case. 

Each  subject  received  a  copy  of  a  case  developed  for  this  study  which 
described  a  fictitious  company  in  the  soft  drink  industry.   The  case  dealt 
with  the  company's  environment,  strengths  and  weaknesses,  and  central 
problems.   Two  alternative  strategies  were  proposed  for  the  company:  the 
acquisition  of  a  winery  and  the  development  of  a  new  soft  drink. 

Subjects  were  randomly  assigned  to  one  of  four  groups,  the  C  (control), 
E,  DA,  and  DIS  groups.   Subjects  in  the  C  group  received  no  additional 
materials  beyond  the  case.   Those  in  the  E  condition  received  a  "planning 
committee  report"  which  contained  an  analysis  of  the  issues  and  data  in  the 
case  and  recommended  acquisition  of  the  winery.   Subjects  in  the  DA  condi- 
tion received  the  same  report  plus  a  critique  from  a  second  "Planning  Com- 
mittee" which  questioned  the  analysis,  assumptions,  and  recommendations  in 
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the  first  planning  committee  report  but  offered  no  alternative  recom- 
mendations.  This  treatment  represents  the  essential  features  of  the 
DA  as  described  by  Mason  (1969).   Subjects  in  the  DIS  condition  received 
the  first  planning  committee  report  plus  a  second  planning  committee 
report,  based  on  alternative  analyses  and  assumptions,  which  offered  a 
different  recommendation.   This  treatment  represents  the  essential 
features  of  the  DIS  as  described  by  Mason  (1969)  and  others.   All  sub- 
jects were  asked  to  prepare  a  planning  document  which  included: 

A)  A  list  of  alternative  courses  of  action  for  the  company. 

B)  The  alternative  they  would  recommend  for  the  company  (one  of 
the  two  listed  in  the  case  or  one  of  their  own). 

C)  A  specific  set  of  recommendations  for  the  implementation  of 
their  chosen  alternative. 

As  part  of  the  study,  subjects  in  each  condition  were  asked  to  complete 
a  questionnaire  after  they  had  finished  developing  their  recommendations. 
The  questionnaire  was  a  modified  version  of  the  one  used  by  Cosier  (1980b). 
In  the  present  questionnaire,  questions  relating  specifically  to  the  finan- 
cial prediction  task  used  in  Cosier' s  study  were  modified  or  omitted. 
Also,  two  questions  relating  to  the  value  of  each  expert's  recommen- 
dations were  deleted.   Though  these  questions  formed  a  separate  factor  in 
Cosier' s  study,  (Value  of  Each  Expert's  Advice)  it  was  felt  that  they 
were  not  conceptually  distinct  from  Cosier' s  questions  relating  to  the 
value  of  the  planning  information. 

Two  forms  of  the  questionnaire  were  prepared.   The  first  form 
contained  twelve  items  and  was  given  to  all  subjects  in  the  E,  DIS,  and 
DA  conditions.   In  the  second  form,  given  to  the  C  subjects,  four 
questions  relating  to  the  value  of  the  planning  committee  report(s)  were 


omitted.   The  format  for  these  items  was  multiple-choice  with  five 
responses  per  item. 

The  two  forms  of  the  post-task  questionnaire  had  eight  items  in  common. 
Subjects  were  asked  to  indicate  their  reaction  to  each  question  by  marking 
a  point  along  a  line  between  two  extreme  points  describing  very  positive 
to  very  negative  reactions  to  the  question  (polar  extremes  of  "positive" 
and  "negative"  were  randomly  altered  over  the  eight  items). 

Results 

Doctoral  students  in  Management  served  as  judges  and  evaluated  the 
quality  of  each  subject's  planning  document  on  six  criteria  suggested  by 
Tilles  (1963)  plus  an  overall  dimension.   Subsequent  ANOVAs  on  the  judges' 
evaluations  showed  no  effects  for  type  of  planning  aid.   This  is  contrary 
to  the  results  of  Cosier  and  Aplin's  (1980)  study  in  which  the  DA  was 
found  to  be  superior  to  the  DIS  on  one  of  the  seven  evaluative  dimensions. 
Thus,  this  research  did  not  support  the  claims  of  the  field  researchers 
that  the  DIS  leads  to  more  effective  problem  solving  and  better  strategy 
statements  than  the  E  approach. 

A  PA1  factor  analysis  with  varimax  rotation  was  run  on  the  question- 
naire items  for  the  E,  DIS,  and  DA  subjects  (Nie,  Hull,  Jenkins, 
Steinbrenner,  and  Bent,  1975).   Only  the  responses  of  the  E,  DIS,  and  DA 
subjects  were  used  to  define  factors  because  the  questionnaire  given  to  the 
C  subjects  did  not  contain  some  of  the  items  on  the  E,  DIS,  and  DA 
questionnaires.   Four  factors  were  identified  and  the  item  composition  of 
these  factors  was  very  similar  to  the  item  composition  of  Cosier' s  (1980b) 
satisfaction,  Value  of  Plans,  Task  Attractiveness,  and  Effort  factors. 
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Therefore,  the  factors  identified  in  this  study  also  labeled: 
Satisfaction,  Value  of  Plans,  Task  Attractiveness,  and  Effort.   Since 
these  factors  were  identified  in  both  studies,  they  seem  to  represent 
stable  categories  for  describing  subjects'  responses  to  the  planning 
aids  and  to  ill-structured  decision-making.   Since  the  questionnaire 
did  not  include  items  relating  to  the  value  of  each  planning  report,  a 
"Value  of  Experts'  Advice"  factor  was  not  identified.   Table  1  shows 
the  four  factors,  the  questions  included  to  define  each  factor,  and 
their  factor  loadings. 


Insert  Table  1  about  here 


Following  the  factor  analysis,  the  subjects'  scores  on  the  relevant 
questions  were  summed  to  generate  their  scores  for  each  factor.   ANOVAs 
were  then  performed  on  the  scores.   No  effects  were  found  for  type  of 
planning  aid  on  the  Value  of  Plans,  Task  Attractiveness,  and  Effort  factors, 
However,  the  ANOVA  for  the  Satisfaction  factor  showed  a  significant  effect 
for  type  of  planning  aid  (F  =  3. 45,  p  <  .02). 

Newman/Keuls  post-hoc  tests  (Winer,  1971)  showed  that  subjects  given 
the  DIS  and  DA  reported  higher  satisfaction  than  those  given  the  E  (see 
Table  2). 


Insert  Table  2  about  here 


Discussion 

Subjects  given  the  DIS  reported  greater  satisfaction  with  the  strategy 
formulation  task  and  with  their  performance  than  did  subjects  given  the  E. 
This  result  confirms  the  findings  of  Emshoff  and  Finnel  (1978),  Mason 
(1969),  Mason  and  Mitroff,  and  Mitroff  et  al. ,  which  showed  that  the 


the  DA  also  reported  higher  levels  of  satisfaction  than  the  E 
subjects.   The  DIS  did  not  lead  to  greater  satisfaction  than  the  DA. 

Neither  the  DA  nor  the  DIS  was  shown  to  be  superior  to  the  E  in 
improving  the  quality  of  strategy  statements.   However,  the  results  of 
earlier  studies  have  shown  the  DA  to  be  superior  to  both  the  E  and  DIS 
treatments  in  a  variety  of  problem-solving  tasks. 

The  results  of  this  study  may  help  to  explain  the  apparent  conflict 
between  the  results  of  the  field  studies  on  the  DIS  and  the  comparative 
studies  on  the  DA  and  DIS.   As  the  field  studies  have  shown,  the  DIS  does 
increase  decision-makers'  satisfaction  with  the  strategy  formulation  task. 
This,  in  turn,  may  cause  them  to  favorably  evaluate  the  DIS.   However, 
neither  the  field  studies  nor  the  comparative  studies  support  the 
assertion   that  the  DIS  improves  decision-makers'  performance  more 
than  the  DA  or  even  the  E.   Proponents  of  the  DIS  may  have  overstated 
their  case  when  they  made  this  assertion. 

One  possible  explanation  for  the  effects  of  the  DA  and  DIS  on  satisfac- 
tion can  be  offered.   There  may  be  a  general  belief  in  our  culture 
that  when  we  have  "heard  both  sides"  of  a  question  we  are  better  able 
to  make  a  decision  on  it.   Decision-makers  given  the  DA  or  the  DIS 
receive  two  conflicting  planning  reports.   Because  of  this,  they  may 
feel  they  are  given  both  sides  of  the  question  of  appropriate  strategy 
for  a  company  and  are  therefore  able  to  make  a  better  decision  on  com- 
pany strategy.   This  should  increase  their  satisfaction  with  the  stra- 
tegy formulation  task. 

However,  earlier  comparative  research  has  shown  that,  in  addition 
to  increasing  satisfaction,  the  DA  also  has  positive  effects  on  per- 
formance.  Eor  this  reason,  the  DA  should  be  recommended  over  the  DIS 
to  managers  wishing  to  improve  the  quality  of  strategic  decisions. 
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